Intervention Component Analysis (ICA): a pragmatic approach for identifying the critical features of complex interventions

Background: In order to enable replication of effective complex interventions, systematic reviews need to provide evidence about their critical features and clear procedural details for their implementation. Currently, few systematic reviews provide sufficient guidance of this sort. / Methods: Through a worked example, this paper reports on a methodological approach, Intervention Component Analysis (ICA), specifically developed to bridge the gap between evidence of effectiveness and practical implementation of interventions. By (a) using an inductive approach to explore the nature of intervention features and (b) making use of trialists’ informally reported experience-based evidence, the approach is designed to overcome the deficiencies of poor reporting which often hinders knowledge translation work whilst also avoiding the need to invest significant amounts of time and resources in following up details with authors. / Results: A key strength of the approach is its ability to reveal hidden or overlooked intervention features and barriers and facilitators only identified in practical application of interventions. It is thus especially useful where hypothesised mechanisms in an existing programme theory have failed. A further benefit of the approach is its ability to identify potentially new configurations of components that have not yet been evaluated. / Conclusions: ICA is a formal and rigorous yet relatively streamlined approach to identify key intervention content and implementation processes. ICA addresses a critical need for knowledge translation around complex interventions to support policy decisions and evidence implementation

Plain Tobacco Packaging: A Systematic Review

(From the Executive Summary): This systematic review outlines findings from 37 studies that provide evidence of the impacts of plain tobacco packaging. The review was conducted following the publication of the March 2011 White Paper Healthy Lives: Healthy People which set out a renewed Tobacco Control Plan for England. One of the key actions identified in the plan was to consult on possible options to reduce the promotional impact of tobacco packaging, including plain packaging. This systematic review was commissioned to provide a comprehensive overview of evidence on the impact of plain packaging in order to inform a public consultation on the issue

Systematic review and meta-analysis of effects of community-delivered positive youth development interventions on violence outcomes

Background We systematically reviewed and meta-analysed evaluations testing the effectiveness of positive youth development (PYD) interventions for reducing violence in young people. Methods Two reviewers working independently screened records, assessed full-text studies for inclusion and extracted data. Outcomes were transformed to Cohen's d. Quality assessment of included evaluations was undertaken using the Cochrane risk of bias tool. Effect sizes were combined using multilevel meta-analysis. We searched 21 databases, including MEDLINE, PsycINFO, CINAHL and CENTRAL, and hand-searched key journals and websites. We included studies where the majority of participants were aged 11–18 years and where interventions were delivered in community (not clinical or judicial) settings outside of normal school hours. We excluded studies targeting predefined physical and mental health conditions or parents/carers alongside young people. We defined violence as perpetration or victimisation of physical violence including violent crime. Results Three randomised trials were included in this systematic review. Included evaluations each had design flaws. Meta-analyses suggested that PYD interventions did not have a statistically significant effect on violence outcomes across all time points (d=0.021, 95% CI −0.050 to 0.093), though interventions did have a statistically significant short-term effect (d=0.076, 95% CI 0.013 to 0.140). Conclusions Our meta-analyses do not offer evidence of PYD interventions in general having effects of public health significance in reducing violence among young people. Evaluations did not consistently report theories of change or implementation fidelity, so it is unclear if our meta-analyses provide evidence that the PYD theory of change is ineffective in reducing violence among young people

The effects of Positive Youth Development interventions on substance use, violence and inequalities: systematic review of theories of change, processes and outcomes

BackgroundPositive Youth Development (PYD) delivered outside school aims to enable young people to develop positive assets such as relationships and confidence, rather than to merely address risk. Existing reviews of PYD effects on substance use or violence are old and unsystematic.ObjectivesTo systematically review evidence to answer the following questions: what theories of change inform PYD interventions addressing substance use and violence? What characteristics of participants and contexts are identified as barriers to and facilitators of implementation and receipt in process evaluations of PYD? What is the effectiveness and cost-effectiveness of PYD in reducing substance use and violence? What characteristics of participants and contexts appear to moderate, or are necessary and sufficient for, PYD effectiveness?Data sourcesA total of 21 bibliographic databases; 35 websites and contacting authors.Review methodsWe included reports published in English since 1985 and reporting on theories of change, as well as process, outcome and economic evaluations of PYD targeting 11- to 18-year-olds and addressing substance use or violence. References were screened on title/abstract and, where appropriate, on full report. Data extraction and quality assessment used Critical Appraisal Skills Programme, Evidence for Policy and Practice Information and Co-ordinating Centre and Cochrane tools. Theories of change and process evaluations were qualitatively metasynthesised. Outcome evaluations were synthesised narratively and meta-analytically.Results32,394 unique references were identified and 48 were included. A total of 16 reports described theories, 13 (10 studies) evaluated processes and 25 (10 studies) evaluated outcomes.Theories of changePYD interventions aim to offer opportunities for young people to develop positive ‘assets’ such as skills and confidence. These are theorised to promote and be promoted by young people’s ‘intentional self-regulation’, which involves reflecting on behaviour; determining goals; using existing resources to pursue these; and redirecting effort when thwarted. This enables ‘developmental regulation’, namely individuals capitalising on other opportunities to promote personal development. Positive assets thus accrued reduce health risks by reducing the impact on individuals of environmental risk or by ameliorating the impact of such risks. The literature offers limited insights beyond these general ideas.Process evaluationsCommunity engagement ensured that programmes were accessible and appealing. Staff capacity and continuity were crucial factors but often challenging when programmes could not offer full-time jobs. Tensions arose between a desire to empower participants to choose activities and a requirement for them to undertake a breadth of activities.Outcome evaluationsMeta-analyses of all combined outcomes and of short-term alcohol use, illicit drug use and smoking found no significant effects. There were small, statistically significant, short-term effects for an omnibus measure of substance use and for violence. We could not undertake metaregression to assess sociodemographic moderators but narrative synthesis suggested no clear pattern of effects by sex. We found no economic evaluations.LimitationsInsufficient studies precluded qualitative comparative analyses.ConclusionsHow PYD might promote health is currently undertheorised. Implementation can be challenging. We found little evidence that current PYD interventions delivered outside school reduce substance use or violence. However, these may not constitute a test of the effectiveness of the PYD model, as some included interventions that, although meeting our inclusion criteria, were not exemplars of PYD.Future workFurther evaluations should assess interventions employing PYD theory of change.Study registrationThis study is registered as PROSPERO CRD42013005439.FundingThe National Institute for Health Research Public Health Research programme.</jats:sec

Mass media to communicate public health messages in six health topic areas: a systematic review and other reviews of the evidence

Background Mass media campaigns can be used to communicate public health messages at the population level. Although previous research has shown that they can influence health behaviours in some contexts, there have been few attempts to synthesise evidence across multiple health behaviours. Objectives To (1) review evidence on the effective use of mass media in six health topic areas (alcohol, diet, illicit drugs, physical activity, sexual and reproductive health and tobacco), (2) examine whether or not effectiveness varies with different target populations, (3) identify characteristics of mass media campaigns associated with effectiveness and (4) identify key research gaps. Design The study comprised (1) a systematic review of reviews, (2) a review of primary studies examining alcohol mass media campaigns, (3) a review of cost-effectiveness evidence and (4) a review of recent primary studies of mass media campaigns conducted in the UK. A logic model was developed to inform the reviews. Public engagement activities were conducted with policy, practitioner and academic stakeholders and with young people. Results The amount and strength of evidence varies across the six topics, and there was little evidence regarding diet campaigns. There was moderate evidence that mass media campaigns can reduce sedentary behaviour and influence sexual health-related behaviours and treatment-seeking behaviours (e.g. use of smoking quitlines and sexual health services). The impact on tobacco use and physical activity was mixed, there was limited evidence of impact on alcohol use and there was no impact on illicit drug behaviours. Mass media campaigns were found to increase knowledge and awareness across several topics, and to influence intentions regarding physical activity and smoking. Tobacco and illicit drug campaigns appeared to be more effective for young people and children but there was no or inconsistent evidence regarding effectiveness by sex, ethnicity or socioeconomic status. There was moderate evidence that tobacco mass media campaigns are cost-effective, but there was weak or limited evidence in other topic areas. Although there was limited evidence on characteristics associated with effectiveness, longer or greater intensity campaigns were found to be more effective, and messages were important, with positive and negative messages and social norms messages affecting smoking behaviour. The evidence suggested that targeting messages to target audiences can be effective. There was little evidence regarding the role that theory or media channels may play in campaign effectiveness, and also limited evidence on new media. Limitations Statistical synthesis was not possible owing to considerable heterogeneity across reviews and studies. The focus on review-level evidence limited our ability to examine intervention characteristics in detail. Conclusions Overall, the evidence is mixed but suggests that (1) campaigns can reduce sedentary behaviour, improve sexual health and contribute to smoking cessation, (2) tobacco control campaigns can be cost-effective, (3) longer and more intensive campaigns are likely to be more effective and (4) message design and targeting campaigns to particular population groups can be effective. Future work Future work could fill evidence gaps regarding diet mass media campaigns and new-media campaigns, examine cost-effectiveness in areas other than tobacco and explore the specific contribution of mass media campaigns to multicomponent interventions and how local, regional and national campaigns can work together

Mass Media for Public Health Messages: Reviews of the Evidence

Background: Mass media campaigns can be used to communicate public health messages at the population level. Although previous research has shown that they can influence health behaviours in some contexts, there have been few attempts to synthesise evidence across multiple health behaviours. Objectives: To: review evidence on the effective use of mass media in six health topic areas (alcohol, diet, illicit drugs, physical activity, sexual and reproductive health, and tobacco); examine whether effectiveness varies with different target populations; identify characteristics of mass media campaigns associated with effectiveness; and identify key research gaps. Design: (A) A systematic review of reviews; (B) a review of primary studies examining alcohol mass media campaigns; (C) a review of cost-effectiveness evidence; (D) a review of recent primary studies of mass media campaigns conducted in the UK. A logic model was developed to inform the reviews. Public engagement activities were conducted with policy, practitioner and academic stakeholders and with young people. Results: The amount and strength of evidence varies across the six topics, and there was little evidence regarding diet campaigns. There was moderate evidence that mass media campaigns can reduce sedentary behaviour and influence sexual health-related behaviours and treatment-seeking behaviours (eg. use of smoking quitlines and sexual health services). Impact on tobacco use and physical activity was mixed, there was limited evidence of impact on alcohol use and no impact on illicit drug behaviours. Mass media campaigns were found to increase knowledge and awareness across several topics, and to influence intentions regarding physical activity and smoking. Tobacco and illicit drug campaigns appeared to be more effective for young people and children but there was no or inconsistent evidence regarding effectiveness by gender, ethnicity or socio-economic status. There was moderate evidence that tobacco mass media campaigns are cost-effective, but weak or limited evidence in other topic areas. Although there was limited evidence on characteristics associated with effectiveness, longer or greater intensity campaigns were found to be more effective, and messages were important, with positive and negative messages and social norms messages affecting smoking behaviour. The evidence suggested that targeting messages to target audiences can be effective. There was little evidence from regarding the role that theory or media channels may play in campaign effectiveness, and also limited evidence on new media. Limitations: Statistical synthesis was not possible due to considerable heterogeneity across reviews and studies. The focus on review-level evidence limited our ability to examine intervention characteristics in detail. Conclusions: Overall the evidence is mixed but suggests that: campaigns can reduce sedentary behaviour, improve sexual health and contribute to smoking cessation; tobacco control campaigns can be cost-effective; longer and more intensive campaigns are likely to be more effective; message design and targeting campaigns to particular population groups can be effective. Future work: Future work could fill evidence gaps regarding diet mass media campaigns and new media campaigns, examine cost-effectiveness in areas other than tobacco, and explore the specific contribution of mass media campaigns to multi-component interventions and how local, regional and national campaigns can work together. This study is registered as PROSPERO CRD42015029205 and PROSPERO CRD42017054999.REF Compliant by Deposit in Stirling's Repositor